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Description 
Stylus-Based Computer Input System 

Background of the Invention 

1. Field of the Invention 

[0001] This invention relates generally to computer input devices, 
and more specifically to hardware and software for stylus 
and mouse input systems. 

2. Description of Related Art 

[0002] A conventional personal computer with a graphical user 
interface (GUI) environment is equipped with a keyboard 
and mouse to input data into the computer system, as 
well as to control cursor movement on a computer screen. 
Other commercially available peripheral input devices in- 
clude joysticks, trackballs, pointers, touchscreens, touch- 
pads, and voice input systems. More specialized mouse 
replacements using foot pedals, head or eye-movement 
tracking, sip-and-puff controls, and joystick-based head 
and mouth control systems have been designed for people 
with limited mobility or muscle control. 



[0003] Even though various input devices are available, most GUI 
programming has been standardized to use a mouse or 
other pointer device that controls the movement of a cur- 
sor or other display elements on a computer screen, and 
that inputs data through click, double-click, drag- 
and-drop, and other mouse-button functions. Typically, a 
user controls a cursor by moving a mouse or other elec- 
tromechanical or electro-optical device over a reference 
surface, such as a rubber mouse pad, specially marked 
paper, optical reference pad, or touchscreen so that the 
cursor moves on the display screen in a direction and a 
distance that is proportional to the movement of the de- 
vice. 

[0004] jhe use of a standard computer mouse often involves 
highly repetitive hand and finger movements and posi- 
tions, and in recent years, has been recognized along with 
other computer activities as a significant source of occu- 
pational injuries in the United States. Repetitive stress 
disorders are attributable to mouse and other pointing 
devices, which entail awkward and stressful movements 
and/or positions for extended periods of time. Computer 
input devices having configurations that force the wrist, 
hand, and fingers of the user to assume awkward and 



stressful positions and/or movements are undesirable. 

[0005] A conventional mouse design requires the fingers of the 
user to be splayed out over the mouse housing with the 
hand in a pronated position, an unnatural position that 
can strain tendons in the hand. Although some more er- 
gonomic mice have housings with 45- to 90-degree up- 
per surfaces to fit into a less twisted palm, finger tendons 
still can be strained with the repeated forefinger flexing 
for mouse button clicking. 

[0006] Among alternative computer pointing devices that have 
been designed with ergonomic features is a joystick 
mouse, which is gripped like a vertical bicycle handle and 
positions the palm perpendicular to the desktop to allow 
fingers to curl inwardly. Unfortunately, a joystick, which is 
manipulated with hand and arm muscles, is better suited 
to gross motor movement than to fine motions often re- 
quired in a GUI environment. 

[0007] Current voice-controlled computer input devices are lim- 
ited to simple commands that control a computer and 
cannot efficiently direct cursor movement. U.S. Patent No. 
5,671,158, Fournier et al., discloses a wireless headset 
with a display and microphone that allows a person to 
communicate commands and some data input by voice to 



a nearby computer. 

[0008] Another type of computer input device tliat lias been de- 
veloped for limited use is an egg-shaped pointing device 
that operates wirelessly in an airborne mode, whereby an 
internal gyroscope detects changes in the position of the 
mouse. These changes are converted to electrical signals 
and transmitted by an internal radio-frequency transmit- 
ter to a receiver at the computer. While effective for lim- 
ited GUI manipulations such moving a screen pointer to 
control projected visual presentations on a wall or com- 
puter display, the bulky mouse housing with left and right 
click mouse buttons is awkward to handle for any ex- 
tended mouse operations. Often this type of device is 
used as both a laser pointer and mouse. 

[0009] With the significant increase of muscular-skeletal prob- 
lems experienced by computer users, designers of com- 
puter peripherals are working to develop more ergonomic 
mouse alternatives that input digitized data and control a 
cursor effectively. One solution is a stylus-based input 
system having a nondigital stylus or writing instrument 
and a pressure-sensitive writing surface. 

[0010] Various technologies have been used to determine the 

position of the stylus, writing instrument or even a finger 



that is placed on the active writing surface of digitizing 
tablets, touchscreens, touchpads, and whiteboards. For 
example, personal computer (PC) tablets may run mag- 
netic pulses through a grid of embedded wires to locate 
the position of the cursor. Some digital whiteboards em- 
ploy ultrasonic triangulation and palm-sized PC systems 
commonly receive data by sensing the touch and move- 
ment of a stylus on the screen surface. 

[0011] A number of touchscreen systems incorporate pressure 
sensitivity. An exemplary touchscreen system of a PC 
tablet and cordless pen has 512 levels of pressure, a 
maximum accuracy of 0.42 mm, and resolution of 3048 
lines per inch. The system works with software to anno- 
tate directly on word-processed documents and create 
and verify signatures electronically. 

[0012] In one type of touchscreen technology, electromagnetic 

radiation such as visible light or radiowaves is used to de- 
termine the position of an object touching the screen. An 
example of a touchscreen system using electromagnetic 
radiation is further described in "Calibration of Graphic 
Data-Acquisition Tracking System," Zurstadt et al., U.S. 
Patent No. 5,583,323 granted December 10, 1996. An- 
other system using surface acoustic waves measures the 



acoustic waves at the edges of a glass plate and calculates 
the position on the plate that is selected by a finger or a 
stylus. Another system uses a stylus that transmits an ul- 
trasound pulse, and then several acoustic sensors on a 
crossbar triangulate and determine the location of the 
stylus or finger. A system that emits an IR signal and an 
acoustic signal from a pen is described in "Transducer 
Signal Waveshaping System," Wood et al., U.S. Patent No. 
6,118,205 granted on September 12, 2000. 
[0013] A second type of touchscreen technology has a homoge- 
nous transparent conductor placed over the surface of a 
display device and a set of bar contacts on the edges of 
the transparent conductor that charge the conductor. The 
capacitive coupling of a stylus or a finger to the transpar- 
ent conductor causes the conductor to discharge while 
sensors attached to the bar contacts measure the amount 
of current drawn through each of the contacts. Analysis of 
the ratios of the currents drawn from pairs of contacts on 
opposing sides of the rectangle provides an X-Y position 
on the panel that is selected by the user. An exemplary 
capacitive touchscreen is taught in "Position Measurement 
Apparatus for Capacitive Touch Panel System," Meadows 
et al., U.S. Patent No. 4,853,498 granted in August 1, 



1989. 

[0014] A third touchscreen technology uses rectangular uniform 
resistive material that is mounted on a flat surface and 
has a series of discrete resistors along the edge. A voltage 
differential is applied to the row of resistors on opposing 
sides of the rectangle and in a time-division manner a 
voltage differential is applied to the row of resistors of the 
other two opposing sides. The position-indicating signals 
are either received by a stylus, or by a conductive overlay 
that can be depressed to contact the surface of the resis- 
tive material. One variety of this device is described in U.S. 
Patent No. 6,650,319, Hurst et al. 

[0015] A fourth touchscreen or touchpad technology uses light- 
receiving and emitting devices to determine the position 
of a stylus or fingertip. One exemplary system that uses 
light-receiving and emitting devices to determine the po- 
sition of a pen or fingertip is taught in "Coordinate Posi- 
tion Inputting/Detecting Device, a Method for Inputting/ 
Detecting the Coordinate Position, and a Display Board 
System," Omura et al., U.S. Patent No. 6,608,619 granted 
August 19, 2003 and U.S. Patent No. 6,429,856 granted 
August 6, 2002. The coordinate position is identified us- 
ing the distribution of light intensity detected by the light 



receiving/emitting devices. 
[0016] A system using optics may liave, for example, a digital 

pen device with a light-emitting diode (LED), at least one 
switch, a rechargeable battery, and a control circuit, as 
well as a wired work surface or tablet with an optical re- 
ceiver. The optical receiver detects the optical output of 
the LED and transmits positional information to a com- 
puter. The pen-like device, which can be used only when 
in contact with the wired work surface or table, incorpo- 
rates a pressure-sensitive tip for effecting different satu- 
ration levels. A stylus or eraser on a whiteboard may be 
tracked using an optical scanner, one system being de- 
scribed in "Code-Based, Electromagnetic- 
Field-Responsive Graphic Data-Acquisition System," 
Mallicoat, U.S. Patent No. 5,623,129 granted April 22, 
1997. 

[OOM] In contrast to systems that have direct interactions with 
the graphical user interface of the computer and are con- 
sidered mouse replacements, digital writing instruments 
capture pen strokes on paper or another writing surface 
and digitize them. In one of these "digital-pen" systems, 
the pen equipped with an optical sensor acts as miniature 
scanner. This application of optical sensor technology has 



had limited success because the scanning digital pen is 
sensitive to the angle at which it is held. The optical sen- 
sor requires that the optical pen be held at a certain an- 
gle, and oriented in the same direction during use. Like 
other specialized pen-based devices with active electrical 
and optical components, this digital pen tends to be bulky 
and unbalanced. 

[0018] Improvements to an optically driven digital pen have been 
suggested in "Digital Pen Using Speckle Tracking," Fagin 
et al., U.S. Patent Application No. 2003/0106985 pub- 
lished June 12, 2003. The digital pen has an ink-writing 
tip and a laser on a pen body to direct light toward paper 
across which the writing tip is being stroked. A comple- 
mentary metal-oxide-semiconductor (CMOS) camera or 
charge coupled device (CCD) is also mounted on the pen 
body for detecting reflections of the laser light, referred to 
as "speckles", and a processor in the pen body determines 
relative pen motion based on the speckles. A contact sen- 
sor on the pen body senses when the tip is pressed 
against the paper, with positions being recorded on a 
flash memory in the pen body when the contact sensor in- 
dicates that the pen is against the paper. 

[0019] One particular method of capturing images of the writing 



tip uses a probability function for determining the lilceli- 
liood of wlietlier tlie pen is toucliing tlie paper, as de- 
scribed in "Camera-Based Handwriting Tracking," IVIunicli 
et a!., U.S. Patent No. 6,633,671 granted October 14, 
2003. The function uses clues including ink on the page 
and/or shadows. 
[0020] Another method for optically detecting movement of a 
pen relative to a writing surface to determine the path of 
the pen is described in "Apparatus and Method for Track- 
ing Handwriting from Visual Input," Perona et al., U.S. 
Patent No. 6,044,165 granted March 28, 2000. A determi- 
nation is made either manually, by looking for a predeter- 
mined pen tip shape, or by looking for a position of maxi- 
mum motion in the image. That kernel is tracked from 
frame to frame to define the path of the writing imple- 
ment, and correlated to the image: either to the whole im- 
age, to a portion of the image near the last position of the 
kernel, or to a portion of the image predicted by a predic- 
tion filter. Limiting the size of area where an image is 
captured and the resulting amount of image data may 
help reduce the amount of data transferred and increase 
the rate of transmission, as suggested in "Handwriting 
Communication System and Handwriting Input Device 



Used Therein," Ogawa, U.S. Patent No. 6,567,078 granted 
May 20, 2003. 

[0021] Optical methods have been used to determine not only 
the position of a pen or finger on a touchscreen, but also 
what type of pointing device is being used. One suggested 
method employs two polarized lights to provide two dif- 
ferent images of the pointing device, from which the 
pointing device can be determined to be a pen or finger, 
as described in "Optical Digitizer with Function to Recog- 
nize Kinds of Pointing Instruments," Ogawa, U.S. Patent 
No. 6,498,602 granted December 24, 2002. 

[0022] A system and method where triangulation is employed for 
determining the location of a pointer on a touchscreen is 
taught in "Diffusion-Assisted Position Location Particularly 
for Visual Pen Detection," Dunthorn, U.S. Patent No. 
5,317,140 granted May 31, 1994. Rather than employing 
focused imaging systems to produce a sharp image at the 
plane of a photodetector, a deliberately diffuse or blurred 
image is employed. The position of the maximum inten- 
sity, and thus the direction of the object, is determined to 
a small fraction of the distance between sample points, 
with an accordingly higher resolution than focused sys- 
tems. 



[0023] A second type of digital-pen technology has a digital pen 
that captures strol<es across a writing substrate by sens- 
ing the time-dependent position of the pen and convert- 
ing the positions to digital representations of the pen 
strokes. In the latter system, digitizing pads, tablets, or 
screens are used to sense pen or stylus motion. 

[0024] The position of a digital pen can be detected by various 
means. IVIagnetic-type digital pens have been designed to 
generate or alter a magnetic field as the pen is moved 
across a piece of paper, with the field being sensed by a 
special pad over which the paper is placed. Ultrasonic- 
type digital pen systems use a pen that generates or alters 
an ultrasonic signal as the pen is moved across a piece of 
paper, with the signal being sensed by a special pad over 
which the paper is placed. 

[0025] Active stylus/pen pointing devices can have mouse-but- 
ton equivalent input buttons on its body as the primary 
switch mechanism, requiring a forefinger tap that can 
strain finger tendons when used repetitively. For example, 
the design of one wireless pen-computing device includes 
a so-called paging button on its front face. Unfortunately, 
such buttons can create awkward and inefficient position 
for the hands and fingers, which may contribute to dis- 



comfort and fatigue of the user during extended use of 
the device. 

[0026] One type of Bluetooth™-enabled pen input device uses 
writing paper with an inl<ed micropattern of coded dots. 
The paper has a near-invisible grid of gray dots that are 
each one-tenth of a millimeter in diameter, and arrayed 
on a slightly displaced grid of 2- by 2-millimeter squares, 
each square with a unique pattern of 36 dots. The pen 
contains a transmitter, microprocessor, memory chip, ink 
cartridge, battery, and a digital camera or optical sensor. 
As the pen writes over the paper, the camera records the 
motion via the micropattern on the paper. For example, 
the camera can take approximately 50 snapshots per sec- 
ond of the paper's dotted pattern and translate the pic- 
tures into a set of (x, y) coordinates to describe the cur- 
rent position of the pen. Digital pens of this type can hold 
40 to 100 images of pages in its memory for uploading 
later to a computer. The captured digital information can 
be transferred later to a computer by syncing the pen via 
a universal serial bus (USB) cradle or by a wireless tech- 
nology such as Bluetooth™. 

[0027] vvith some digital pen systems, the user checks a specified 
location on the microcoded paper to indicate that a page 



is completed, after which the final information is stored 
on the 1 MB built-in memory chip. Typically, there is a 
limitation such as 25 pages of notes before this digital 
pen needs to be recharged. When the pen is placed into 
its cradle, the information stored on the memory chip is 
transferred to the connected computer, and the pen is 
recharged. Digital-pen systems sometimes include hand- 
writing recognition software that converts pen strokes 
into a digitally stored record of the writing. 

[0028] One of the disadvantages systems with electronically ac- 
tive digital pens, are that they tend to be quite bulky and 
may be unbalanced when, for example, the camera is 
placed near the writing tip of the pen. Thus, these longer 
pens as a whole are somewhat awkward to use, particu- 
larly for extended periods of time. Other limitations may 
include a limited battery life, requirement for specialized 
ink cartridges, and the need for specialized and costly 
writing paper or surface. 

[0029] While most stylus and touchpad/touchscreen systems do 
not involve a traditional paper or pen, a few computer in- 
put systems are being developed to use conventional pens 
to write on paper while an electronically active surface si- 
multaneously captures the handwritten images for com- 



puter input. One data input system is envisioned as a 
notebool<-sized portfolio having a liand or tablet-sized 
computer, a paper writing surface for conventional ink, 
and a digital notepad as described in "Apparatus and 
Method for Portable Handwriting Capture," Challa et al., 
U.S. Patent No. 6,396,481 granted May 28, 2002. The dig- 
ital notepad uses electromagnetic, resistivity, or laser- 
digitizing technology to capture what is written and then 
transfers the captured image to the small computer. In- 
frared transceivers of the computer and the notepad are 
aligned for wireless communication. 

[0030] Researchers are working on developing more inexpensive 
and flexible mobile information appliances that tie exist- 
ing pen and paper activities to computer data entry pro- 
cedures, simultaneously capturing the data both physi- 
cally and electronically. 

[0031] Researchers are also working to extend the functions of 

digital pens beyond graphics and data entry to mouse-like 
functions such as cursor control and menu navigation. 
One proposed pen design has a Bluetooth™-enabled pen 
with an optical translation measurement sensor placed at 
the tip of the pen to measure motion relative to the writ- 
ing surface. The sensor uses a laser source to illuminate 



the writing surface, which may be almost any flat surface. 
[0032] One of the primary motivations for developing mouse re- 
placements such as the one just mentioned is the signifi- 
cant increase of carpel tunnel syndrome and other mus- 
cular-skeletal problems experienced by those using a 
computer for many hours. Pointing devices such as a 
computer mouse can require repetitive hand and finger 
movements in awkward or stressful positions of the wrist, 
hand and fingers, which can lead to repetitive stress in- 
juries. 

[0033] Replacements for the computer mouse should be simple 
to operate and have accurate positioning capability, while 
allowing a user to remain in a natural, relaxed position 
that is comfortable for extended periods of use. A desir- 
able computer input system avoids using bulky or unbal- 
anced input devices, specialized ink cartridges and paper, 
batteries, and restrictive wiring. An improved mouse re- 
placement maximizes the productivity of the user and 
makes better use of workspace. An expanded use of a 
computer input device would provide pen-point accuracy, 
have an ability to input freeform information such as 
drawing or handwriting, allow electronic input of hand- 
written signatures, and have an ability to capture and dig- 



itally transfer symbols and alphabet characters not avail- 
able with a QWERTY l<eyboard, and functions of a conven- 
tional computer mouse. 
Summary of the Invention 

[0034] Qne aspect of the invention provides a system for deter- 
mining a stylus position of a stylus. The system includes a 
telemetric imager and a controller electrically coupled to 
the telemetric imager. The controller determines the sty- 
lus position based on a generated image of a stylus tip 
from a first direction and a generated image of the stylus 
tip from a second direction when the stylus tip is in a sty- 
lus entry region. 

[0035] Another aspect of the invention is a method of determin- 
ing a stylus position. A stylus tip of a stylus is positioned 
in a stylus entry region. An image of the stylus tip from a 
first direction and an image of the stylus tip from a sec- 
ond direction are generated. The stylus position is deter- 
mined based on the generated images from the first di- 
rection and the second direction when the stylus tip is in 
the stylus entry region. 

[0036] Another aspect of the invention is a system for determin- 
ing a stylus position, including means for positioning a 
stylus tip of a stylus in a stylus entry region, means for 



generating an image of tlie stylus tip from a first direc- 
tion, means for generating an image of tlie stylus tip from 
a second direction, and means for determining the stylus 
position based on the generated images from the first di- 
rection and the second direction when the stylus tip is in 
the stylus entry region. 
[0037] Other aspects, features and attendant advantages of the 
present invention will become more apparent and readily 
appreciated by the detailed description given below in 
conjunction with the accompanying drawings. The draw- 
ings should not be taken to limit the invention to the spe- 
cific embodiments, but are for explanation and under- 
standing. The detailed description and drawings are 
merely illustrative of the invention rather than limiting, 
the scope of the invention being defined by the appended 
claims and equivalents thereof. 
Brief Description of the Drawings 

[0038] Various embodiments of the present invention are illus- 
trated by the accompanying figures, wherein: 

[0039] piQ^ I illustrates a system for determining a stylus position 
of a stylus, in accordance with one embodiment of the 
current invention; 

[0040] piQ_ 2 illustrates a system for determining a stylus position 



of a stylus, in accordance with anotlier embodiment of tlie 
current invention; 

[0041] piQ 3 is a block diagram of a system for determining a 
stylus position, in accordance with another embodiment 
of the current invention; 

[0042] piQ^ 4 is a flow diagram of a method for determining a sty- 
lus position, in accordance with one embodiment of the 
current invention; 

[0043] piQ_ 5 is a flow diagram of a method for determining a sty- 
lus position, in accordance with another embodiment of 
the current invention; 

[0044] piQ^ 6 is a flow diagram of a method for determining a sty- 
lus position, in accordance with another embodiment of 
the current invention; and 

[0045] piQ^ 7 is a flow diagram of a method for determining a sty- 
lus position, in accordance with another embodiment of 
the current invention. 
Detailed Description of the Invention 

[0046] piQ_ I illustrates a system for determining a stylus position 
of a stylus, in accordance with one embodiment of the 
present invention. A system iO, which determines a stylus 
position 12 of a stylus 20, includes a telemetric imager 30 
electrically connected to a controller 40. Controller 40 de- 



termines stylus position 12 based on a generated image of 
a stylus tip 18 of stylus 20 from a first direction 14 and a 
generated image of stylus tip iSfrom a second direction 
16 when stylus tip 18 is in a stylus entry region 50. Stylus 
tip 18 refers herein to one end or the other of stylus 20 
along with the region proximate to the cited end. Stylus 
entry region 50 corresponds to a region where stylus posi- 
tion 12 of Stylus 20 is capable of being determined such 
as, for example, a bounded physical surface and the re- 
gion above the physical surface. Stylus entry region 50 
may be real or virtual. Stylus information output 46 may 
be sent to a digital computing device through a wired or 
wireless communication port 48. 
[0047] Stylus 20 is an instrument such as a pen, pencil, pointer or 
marker that may be adapted to allow ready recognition by 
telemetric imager 30. Stylus tip 18 may write on a writable 
medium 52 positioned in stylus entry region 50 while con- 
troller 40 determines stylus position 12. Stylus 20 may be 
adapted to have a reflective element formed with or 
fixedly attached to stylus 20 at or near one end or the 
other. Stylus 20 may include an imaging target such as a 
writing-mode imaging target 22 near a writing end 24 of 
stylus 20. Alternatively or additionally, stylus 20 may in- 



elude an erasing -mode target 26 near an erasing end 28 of 
stylus 20. Writing-mode imaging target 22 may be coupled 
to or formed on stylus 20 near writing end 24 of stylus 20 
to indicate a writing mode wlien stylus tip 18 is in stylus 
entry region 50. Additionally or alternatively, erasing- 
mode imaging target 26 may be coupled to or otherwise 
formed on stylus 20 near erasing end 28 of stylus 20 to in- 
dicate an erasing mode when stylus tip 18 is in stylus en- 
try region 50. Stylus 20 with erasing end 28 allows erasing 
of writable medium 52 while controller 40 determines sty- 
lus position 12. Imaging targets 22and26, such as coded 
bars, bands or crosses, may include information about the 
stylus tip angle, stylus tip rotation, stylus type, stylus size, 
or stylus ink color. Additional features may be added to 
stylus 20, such as self-illuminative imaging targets 22 and 
26, or switches that invoke transmissions to telemetric 
imager 30 to indicate one or more stylus functions. 
[0048] Writing end 24 of stylus 20, which can deposit material 
such as pencil graphite, pen ink, or marker ink when 
moved over writable medium 52, may be shaped in a 
round, squared, or chiseled fashion to control the de- 
positing of writing material. For example, Styli 20 can be 
designed for digital entry of calligraphy with system 10. 



[0049] The position of aforementioned stylus 20 may be calcu- 
lated or otherwise determined by controller 40 using sty- 
lus image information 42 generated from telemetric im- 
ager 30. Telemetric imager 30 includes, for example, two 
separated optical imaging arrays 32a and 32b such as 
complementary metal-oxide-semiconductor (CMOS) 
imaging arrays or charge-coupled device (CCD) imaging 
arrays to generate images of stylus tip 18 from first direc- 
tion 14 and images of stylus tip 18 from second direction 
i6 when stylus tip 18 is in stylus entry region 50. Alterna- 
tively, telemetric imager 30 may include single optical 
imaging array 32, as illustrated in FIG. 3, to generate im- 
ages of stylus tip 18 from first direction 14 and images of 
stylus tip iSfrom second direction i6when stylus tip I8 \s 
in stylus entry region 50 using, for example, a set of 
binocular optics or another type of optical element (not 
shown). Other types of optical elements that may help 
form images on one or more optical imaging arrays 32 in- 
clude a slit, a pinhole, a lens, a mirror, a curved mirror, a 
lens array, a mirror array, a prism, a reflective element, a 
refractive element, a focusing element, or a combination 
thereof. Optical imaging arrays 32 or 32a and 32h serve as 
an optical imager for optical images of stylus tip 18 



formed thereon and provide stylus image information 42 
to controller 40. Controller 40 may run or execute com- 
puter program code to determine stylus position i2 and to 
provide other functions. 

[0050] A surface of stylus entry region 50 may comprise writable 
medium 52, such as a sheet or pad of paper. Alternatively, 
writable medium 52 such as a sheet of paper, a notebook 
or a notepad may be positionable in stylus entry region 50 
on top of a surface of stylus entry region 50. 

[0051] In one embodiment, a light source 60 is positioned near 
telemetric imager 30 to illuminate stylus tip iSwith emit- 
ted light 62 when stylus tip IS is in stylus entry region 50. 
Exemplary light sources 60 such as a light-emitting diode 
(LED), a laser diode, an infrared (IR) LED, an IR laser, a vis- 
ible LED, a visible laser, an ultraviolet (UV) LED, a UV laser, 
a light bulb, or a light-emitting device, may be modulat- 
able or unmodulatable. 

[0052] In another embodiment, controllable light source 60 is po- 
sitioned near telemetric imager 30. Light source 60 may be 
controlled, for example, with a light source control signal 
44 generated from controller 40. A first set of images of 
stylus tip iSfrom first direction 14 and second direction 
i6 is generated with light source 60 turned on to illumi- 



nate stylus tip iSwith emitted liglit 62 from liglit source 
60, and a second set of images of stylus tip 18 from first 
direction 14 and second direction 16 is generated with 
light source 60 turned off. A comparison is made between 
the first set of images and the second set of images to 
determine stylus position 12. For example, stylus image 
information 42 from the first set of images is subtracted 
on a pixel-by-pixel basis to result in a cancellation of sty- 
lus image information 42 for objects lit with ambient 
lighting, while stylus image information 42 from objects 
such as stylus tip 18 lit with emitted light 62 are empha- 
sized. Stylus tip iS alone or with imaging targets 22 and 26 
positioned near stylus writing end 24 and erasing end 28, 
respectively, may be readily detected by telemetric imager 
30, even with large amounts of ambient lighting on stylus 
20. Stylus tip iS or imaging targets 22 and 26 may be fur- 
ther accentuated using reflective or retroreflective paint or 
other highly reflective medium. 
[0053] An optical filter 64 may be positioned between telemetric 
imager 30 and stylus tip 18 to preferentially pass light 62 
from stylus tip 18 to telemetric imager 30. Optical filter 64, 
for example, preferentially passes light of the same wave- 
length or set of wavelengths as that of light 62 emitted 



from light source 60 positioned near telemetric imager 30. 
Optical filter 64 may have a narrow passband to transmit 
light 62 in a narrow range of wavelengths while blocking 
light of other wavelengths to decrease the effects of am- 
bient lighting. Optical filter 64 may be positioned in front 
of optical imaging array 32, in front of light source 60, or 
in front of both. 

[0054] In an exemplary embodiment of the present invention, 
communication port 48 is connected to controller 40 to 
enable communication between controller 40 and a digital 
computing device. Communication port 48 may be a wired 
or wireless port such as a universal serial bus (USB) port, a 
Bluetooth™-enabled port, an infrared port, an RJ-11 tele- 
phone jack, an RJ-45 fast Ethernet jack, or any other serial 
or parallel port for built-in WAN, LAN or WiFi wireless or 
wired connectivity. 

[0055] A housing 70 may be included with system iO to contain 
telemetric imager 30 and controller 40, as well as, for ex- 
ample, a Bluetooth™ microchip that can communicate with 
other Bluetooth™ device such as a mobile phone or per- 
sonal digital assistant within proximity to system iO for 
determining stylus position 12. Optionally, housing 70 has 
one or more stylus holders such as a penwell to receive 



stylus 20 for stylus storage. 

[0056] piQ_ 2 illustrates a system for determining a stylus position 
of a stylus, in accordance with another embodiment of the 
present invention. Like-numbered elements correspond to 
similar elements in the previous and following figures. 

[0057] A stylus position determination system 10 includes a 

housing 70 containing a telemetric imager 30 and a con- 
troller 40 to detect and determine the position of a stylus 
when the stylus is in a stylus entry region. Controller 40 is 
electrically coupled to telemetric imager 30, and may be 
included with or separate from telemetric imager 30. Con- 
troller 40 determines the stylus position based on a gen- 
erated image of a stylus tip from a first direction and on a 
generated image of the stylus tip from a second direction 
when the stylus tip is in the stylus entry region. 

[0058] An exemplary configuration of telemetric imager 30 in- 
cludes one or two optical imaging arrays and associated 
optics to generate the images of the stylus tip from two 
directions, allowing for the telemetric determination of the 
stylus position when the stylus tip is in the stylus entry 
region. 

[0059] A light source 60, such as such as an LED, a laser diode, a 
light bulb or a light-emitting device, may be coupled to 



housing 70 near telemetric imager 30 to illuminate the 
stylus tip. Light source 60 may be modulatable or unmod- 
ulatable, and controlled to generate images either with 
light source 60 on or with light source 60 off. When light 
source 60 is modulated, a comparison can be made be- 
tween images with light source 60 on and off to determine 
the stylus position, even with significant amounts of am- 
bient lighting. 

[0060] In one embodiment of the present invention, one or more 
optical filters 64 are coupled to housing 70 to preferen- 
tially pass light 62 from the stylus tip to telemetric imager 

30. 

[0061] Exemplary system 10 has a communication port 48 such as 
a wired port or a wireless port that is connected to con- 
troller 40 to enable communication between controller 40 
and a digital computing device. Housing 70 can provide 
for and contain hardware associated with wired communi- 
cation port 48 such as a USB port and take the form of a 
connectivity stand, pod or cradle. Alternatively, system 10 
may be connected to or built into a keyboard, keypad, 
desktop computer, laptop computer, tablet computer, 
handheld computer, personal digital assistant, stylus- 
based computer with or without a keyboard, calculator, 



touchscreen, touchpad, digitizing pad, wliiteboard, cell 
phone, wireless communication device, smart appliance, 
electronic gaming device, audio player, video player, or 
other electronic device. 

[0062] Optionally, housing 70 has one or more stylus holders 72 
for holding and storing a stylus such as a writing instru- 
ment. For example, stylus holder 72 may store a pen, pen- 
cil, pointer or marker that is not in use. 

[0063] 3 is a block diagram of a system for determining a 
stylus position, in accordance with another embodiment 
of the present invention. A stylus position determination 
system iO determines a position of a stylus 20, for exam- 
ple, when a stylus tip 18 of stylus 20 is in a stylus entry re- 
gion 50. An image of stylus tip 18 is generated from a first 
direction 14 and an image of stylus tip 18 is generated 
from a second direction i6 when stylus tip 18 is in stylus 
entry region 50. The stylus position may be determined 
based on the generated images from first direction 14 and 
second direction 16. A controller 40 running suitable mi- 
crocode may be used for functions such as determining 
the stylus position based on the generated images. 

[0064] System 10 may include a controllable light source 60 for 
emitting light 62 that can reflect off of a portion of stylus 



20, a light detector for detecting reflected light 62 from 
stylus tip 18 of stylus 20 from a first direction 14 and from 
second direction 16, and an electronic device for deter- 
mining the stylus position based on detected light 62 from 
first direction 14 and second direction 16. System 10 may 
include an electronic device (not shown) to turn off con- 
trollable light source 60, a light detector to detect re- 
flected ambient light from first direction 14 and second 
direction 16, and a digital computing device for determin- 
ing the stylus position based on differences between de- 
tected light 62 from first direction 14 and second direction 
i6when light source 60 is on, and detected light 62 from 
first direction 14 and second direction i6 when light 
source 60 is off. 

[0065] Stylus 20 such as a pen, pencil, pointer or marker is posi- 
tioned in stylus entry region 50, for example, with a hu- 
man hand gripping stylus 20 near a writing end or an 
erasing end. A writing mode or an erasing mode may be 
indicated, for example, with a writing-mode imaging tar- 
get positioned near a writing end of stylus 20 and an eras- 
ing-mode imaging target positioned near an erasing end 
of stylus 20. Stylus 20 may be used for writing or erasing 
while the position of stylus 20 is determined. Stylus entry 



region 50 may enclose, for example, a non-writable sur- 
face area such as a mouse pad, or a writable surface such 
as a sheet of paper or a pad of paper. At the preference of 
a user, a writable medium 52 such as a sheet of paper, a 
notebook or a notepad can be positioned in stylus entry 
region 50 and then written upon, during which time a re- 
lay of information on the changing stylus positions is be- 
ing entered into system iO and any externally connected 
digital computing device. 
[0066] Stylus tip 18 is detected when positioned in stylus entry 
region 50, such as when stylus tip 18 is in contact with a 
surface corresponding to stylus entry region 50. Images of 
stylus tip 18 may be generated from two different direc- 
tions, for example, with one or two optical imaging arrays 
32 such as CMOS or CCD imaging arrays and associated 
binocular or telemetric optics in a telemetric imager 30. 
Determination of stylus position may be made, for exam- 
ple, with controller 40 running code to capture output 
from optical imaging arrays 32 and to compute the x, y 
and z location of stylus tip iSfrom telemetric formulas, 
pattern-recognition techniques, or a suitable model based 
on the stylus image information 42. Controller 40 may be 
part of or separate from telemetric imager 30. 



[0067] Stylus tip 18 may be illuminated, for example, with light 
source 60 such as a LED, a laser diode, a light bulb, or a 
light-emitting device mounted near one or more optical 
imaging arrays 32 to illuminate stylus tip 18. For example, 
a light source control signal 44 can turn on light source 60 
to illuminate stylus tip i8 while generating a first set of 
images from two directions 14 and 16, and then turn off 
light source 60 while generating a second set of images 
from two directions 14 and 16. Data from the two sets of 
images may be compared, for example, by subtracting the 
digital output of one from the other, and determining the 
stylus position based on the differences. An optical filter 
64 may be used to filter out the majority of ambient light- 
ing while passing through to telemetric imager 30 light 62 
that is emitted from light source 60 and reflected off of at 
least a portion of stylus 20. 

[0068] Pattern recognition or formulation techniques may be 

used, for example, to determine whether stylus 20 is in a 
writing mode or an erasing mode when stylus tip 18 is in 
stylus entry region 50. For example, a writing-mode 
imaging target placed near a writing end of stylus 20 may 
be used to indicate stylus position and writing-mode op- 
eration. Similarly, an erasing-mode imaging target placed 



near an erasing end of stylus 20 may be used to indicate 
stylus position and erasing-mode operation. Pattern 
recognition may be used, for example, to recognize a pre- 
determined tip shape or to locate and interpret a prede- 
termined target on stylus 20. 

[0069] The angle of stylus 20 with respect to stylus entry region 
50 may be determined, for example, with the aid of sty- 
lus-angle imaging targets when stylus tip 18 is in stylus 
entry region 50. Similarly, an angle of stylus rotation may 
be determined, for example, with the aid of stylus-rota- 
tion imaging targets. For example, determining the angle 
and rotation of stylus 20 is particularly beneficial to styli 
20 that are used for calligraphy. Exemplary stylus tip 18 of 
stylus 20 may write on conventional writable medium 52 
such as a sheet of paper when stylus tip 18 is on writable 
medium 52 in stylus entry region 50. Stylus 20 can be sim- 
ilar to a conventional pen, pencil or marker, or a pen, 
pencil or marker that is adapted to improve position de- 
termination capability. 

[0070] When stylus tip 18 is in stylus entry region 50, stylus infor- 
mation output 46 such as x, y and z coordinates, scaled x, 
y and z coordinates, or x and y coordinates may be sent 
with a wired or wireless connection to a digital computing 



device such as a laptop, personal digital assistant (PDA), 
cell phone, electronic gaming device, tablet PC, stylus- 
based computer with or without a keyboard, personal 
computer (PC), smart appliance, or other electronic device 
using standard connection and communication protocols. 
A wired or wireless communication port 48 may be used to 
enable communications between system iO and a digital 
computing device connected to system 10. 
[0071] Stylus information output 46 may be interpreted, for ex- 
ample, with a software application running in controller 40 
of system 10 or in a digital computing device connected to 
system 10. Interpretations of stylus position include but 
are not limited to a distance determination between stylus 
tip 18 and a surface in stylus entry region 50, a determina- 
tion of whether stylus tip 18 is in contact with a surface in 
stylus entry region 50, a determination of a writing mode 
or an erasing mode, handwriting input information, draw- 
ing input information, mouse functions such as clicks and 
double-clicks, selection functions, soft-key selections, 
drag-and-drop functions, scrolling functions, stylus 
stroke functions, and other functions of computer input 
devices. Stylus information output 46 is interpreted as, for 
example, writing input information, drawing input infor- 



mation, pointer input information, selection input infor- 
mation, or mouse input information. 
[0072] In another embodiment, system 10 includes two or more 
light sources 60 that are positioned near telemetric imager 
30. Light sources 60 are spatially separated and turned on 
in a suitable sequence. Light 62 reflected from imaging 
targets of stylus 20 appears to emanate from a slightly 
different angle or point, allowing telemetric imager 30 
with one or two optical imaging arrays 32 to provide stylus 
image information 42 that can be used to determine the 
position of stylus 20. In a first example, two horizontally 
separated light sources 60 are sequentially flashed. Stylus 
images formed on optical imaging array 32 with reflected 
light 62 from a cylindrically disposed imaging target are 
processed to determine the position of stylus tip 18. The 
stylus position may be determined with a pair of optical 
imaging arrays 32 and an associated pair of imaging op- 
tics or with a single optical imaging array 32 and a single 
set of imaging optics. In a second example, two vertically 
separated light sources 60 are sequentially flashed. Stylus 
images formed on one or more optical imaging arrays 32 
are processed to determine the stylus position. In a third 
example, a triad or quad array of light sources 60 is con- 



figured and sequenced to provide stylus image informa- 
tion 42 from wliicli tlie stylus position is determined. In a 
fourth example, two or more spatially separated light 
sources 60 are lit in sequence to wobble sequential images 
off of a curved imaging target on stylus 20, and then the 
images are compared or subtracted to determine the sty- 
lus position. 

[0073] piQ^ 4 is a flow diagram of a method for determining a sty- 
lus position, in accordance with one embodiment of the 
present invention. 

[0074] A stylus tip of a stylus is positioned in a stylus entry re- 
gion, as seen at block 100. The stylus, such as a pen, pen- 
cil, pointer, marker, or a writing, marking or pointing in- 
strument adapted thereto, includes a stylus tip. The stylus 
tip may be positioned in the stylus entry region, where 
contact can be made with a surface associated with the 
stylus entry region. 

[0075] An image of the stylus tip from a first direction and an 

image of the stylus tip from a second direction are gener- 
ated, as seen at block 102. Images of the stylus tip from 
two directions allow the triangulation and determination 
of the position of the stylus tip when the stylus tip is in 
the stylus entry region. In one example, the image of the 



stylus tip from the first direction is generated with a first 
optical imaging array and the image of the stylus tip from 
the second direction is generated with a second optical 
imaging array. In another example, the image of the stylus 
tip from the first direction and the image of the stylus tip 
from the second direction are generated with one optical 
imaging array. 

[0076] The stylus position is determined based on the generated 
images from the first direction and the second direction, 
as seen at block 104. The stylus position is determined, 
for example, with pattern-recognition algorithms that de- 
termine the position of the stylus tip and whether the sty- 
lus tip is in contact with the surface corresponding to the 
stylus entry region. Alternatively, the stylus position may 
be determined using telemetric formulas or other suitable 
stylus position determination algorithm. 

[0077] piQ^ 5 is a flow diagram of a method for determining a sty- 
lus position, in accordance with another embodiment of 
the present invention. 

[0078] A stylus tip of a stylus is positioned in a stylus entry re- 
gion, as seen at block no. When in the stylus entry re- 
gion, the stylus tip may write on a writable medium such 
as a sheet or pad of paper positioned in the stylus entry 



region. Alternatively, the writable medium may form a 
surface of the stylus entry region. 

[0079] Images of stylus tip from a first direction and from a sec- 
ond direction are generated, as seen at block 112. A CMOS 
or CCD imaging array may be used, for example, to gen- 
erate the images. 

[0080] The stylus position is determined based on the generated 
images from the first direction and the second direction 
when the stylus tip is in the stylus entry region, as seen at 
block 114. The image of the stylus tip from the first direc- 
tion may be generated with a first optical imaging array 
and the image of the stylus tip from the second direction 
may be generated with a second optical imaging array. Al- 
ternatively, the image of the stylus tip from the first direc- 
tion and the image of the stylus tip from the second di- 
rection are generated with one optical imaging array. The 
stylus position may be determined using, for example, 
telemetric formulations or pattern recognition techniques 
to ascertain the coordinate location of the stylus tip and 
the distance that the stylus tip is from the surface associ- 
ated with the stylus entry region. A writing mode or an 
erasing mode can be determined when the stylus tip is in 
the stylus entry region. The stylus angle may be deter- 



mined. The stylus rotation may also be determined when 
the stylus tip is in the stylus entry region. For example, 
imaging targets affixed near one end or the other of the 
stylus are coded or otherwise differentiable to enable de- 
termination of a writing or an erasing mode, stylus tip- 
angle information, or stylus tip-rotation information in 
addition to stylus position. 

[0081] The stylus position such as absolute or relative stylus co- 
ordinate data is sent to a digital computing device, as 
seen at block 116. The stylus position may be sent by a 
wired or a wireless connection to a digital computing de- 
vice such as a laptop computer, cell phone, personal digi- 
tal assistant, electronic gaming device, tablet PC, stylus- 
based computer with or without a keyboard, desktop per- 
sonal computer, smart appliance, or other electronic de- 
vice. For example, the stylus may be used to input and 
erase information for a two-dimensional (2D) or three- 
dimensional (3D) crossword puzzle game or a 2D or 3D 
Scrabble game on an interactive screen. 

[0082] The stylus position is interpreted, as seen at block 118. 
Handwriting information, script information, drawing in- 
formation, selection information, pointer functions, 
mouse functions, writing-mode functions, erasing-mode 



functions, stylus stroke functions and input from prede- 
fined stylus movements may be interpreted using suitable 
software applications running locally or externally in a 
connected digital computing device. Applications such as 
word-processing programs, spreadsheets, Internet pro- 
grams or games running on the connected digital com- 
puting device may respond to the stylus coordinate data 
and the stylus stroke functions. For example, a file gener- 

ated using Microsoft Word, PowerPoint , Excel, Internet 

® 

Explorer, or Outlook from Microsoft Corporation, a .pdf 
file generated using Adobe Acrobat , a computer-aided 
design file generated using AutoCAD from Autodesk , a 
3D CAD file generated using SolidWorks from SolidWorks 
Corporation or a Nintendo electronic game may be up- 
dated or responded to based on stylus input information. 
[0083] piQ_ g is a flow diagram of a method for determining a sty- 
lus position, in accordance with another embodiment of 
the present invention. A stylus tip of a stylus is positioned 
in a stylus entry region, as seen at block 120. The stylus 
tip is illuminated with a light source when the stylus tip is 
in the stylus entry region, as seen at block 122. An image 
of the stylus tip from a first direction and an image of the 
stylus tip from a second direction are generated, as seen 



at block 124. The images may be generated, for example, 
using one or two optical imaging arrays and associated 
optics. The stylus position is determined based on the 
generated images from the first direction and the second 
direction when the stylus tip is in the stylus entry region, 
as seen at block 126. 

[0084] piQ^ 7 is a flow diagram of a method for determining a sty- 
lus position, in accordance with another embodiment of 
the present invention. A stylus tip of a stylus is positioned 
in a stylus entry region, as seen at block 130. A control- 
lable light source is switched on to illuminate the stylus 
tip, as seen at block 132. A first set of images of the stylus 
tip from a first direction and from a second direction is 
generated, for example, with one or two optical imaging 
arrays and associated optics. The light source is switched 
off, and a second set of images of the stylus tip from the 
first direction and from the second direction is generated, 
as seen at block 134. The first set of generated images is 
compared with the second set of generated images, as 
seen at block 136. The stylus position is determined based 
on the comparison, as seen at block 138. 

[0085] While the embodiments of the invention disclosed herein 
are presently considered to be preferred, various changes 



and modifications can be made without departing from 
tlie spirit and scope of tlie invention. For example, wliile 
tlie embodiments of the invention are presented as com- 
municating with a desktop personal computer, the inven- 
tion can work with a cellular phone, personal digital assis- 
tant, electronic gaming device, tablet PC, stylus-based 
computer with or without a keyboard, smart appliance, 
other devices having a digital signal processor and GUI in- 
terface, or other electronic device. The scope of the in- 
vention is indicated in the appended claims, and all 
changes that come within the meaning and range of 
equivalents are embraced herein. 



